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Abstract 

Loynes' distribution, which characterizes the one dimensional marginal of the stationary 
solution to Lindley's recursion, possesses an ultimately exponential tail for a large class of 
increment processes. If one can observe increments but does not know their probabilistic 
properties, what are the statistical limits of estimating the tail exponent of Loynes' distri- 
bution? We conjecture that in broad generality a consistent sequence of non-parametric 
estimators can be constructed that satisfies a large deviation principle. We present rigorous 
support for this conjecture under restrictive assumptions and simulation evidence indicating 
why we believe it to be true in greater generality. 



1 Introduction 

If {X{n)} is a stationary, ergodic process with E(X(1)) < 0, then Loynes [20J proved that there 
is a stationary process satisfying Lindley's recursion [19j . 

W{n + 1) = \W{n) + X(n + 1)]+ for all n € Z, 

and that all other solutions couple to it in almost surely finite time. A one dimensional marginal 
of the stationary solution is equal to Loynes' distribution, the distribution of the random variable 
W — sup n >g X^i=i w here the empty sum X^i=i -^(X) * s defined to be 0. 

We are interested in estimating the tail behavior of Loynes' distribution. Consider the partial 
sums process {S(n)/n}, where S(n) := X(l) + • • • + X(n). Its associated scaled Cumulant 
Generating Function (sCGF) A and associated Loynes' exponent 6* are defined as follows, 

X(9) := lim -logE\e 9S{n) ] , 0* := sup(0 : X(9) < 0). (1) 

n^oo 71 

In an advance on the generality of earlier results, Glynn and Whitt [15\ Theorem 1] proved the 
following, which justifies the terminology Loynes' exponent. 

Theorem 1 (|15j) Assume that: (i) {X(n)} is strictly stationary; (ii) A(0) is finite in a neigh- 
borhood of 6*, differentiable at 9* with X(9*) = and X'(9*) > 0; and (Hi) that E(exp(6* S(n)) < 
oo for all n> 1. Then Loynes' distribution has an ultimately exponential tail 

lim - log P(W >n) = -9* . (2) 

n— *oo n 
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Note that Lelarge Proposition 1] has recently shown that condition (ii) can be relaxed. The 
uniform bound, condition (iii), ensures that large W is caused by the cumulative behavior of a 
collection of increments {X(n)} rather than a single exceedingly large increment. 

Theorem [T] is of practical interest as it says that, for large n and a sizeable collection of increment 
processes {X(n)}, P(W > n) ~ e~ nd * . If 9* is known, this provides an estimate of the likelihood 
of long waiting times or large queue- lengths, and hence quality-of-service metrics. This has 
generated interest in estimating 9* on-the-fly from observations to predict queueing behavior in 
ATM networks. For example, see early work of Courcoubetis et al. [I] and Dufneld et al. [6]. 

Acknowledgment Financial support from the National Science Foundation (NSF CCF 07-29031), AFOSR 
(FA9550-09-1-0190) and Science Foundation Ireland (07/IN. 1/1901) is gratefully acknowledged. Any opinions, 
findings, and conclusions or recommendations expressed in this material are those of the authors and do not 
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2 Estimating Loynes' exponent, a conjecture 

If you can observe a sequence of consecutive increments, X(l), . . . , X(n) (or, alternatively, 
W(l), . . . , W(n)) and wish to estimate Loynes' exponent, 9* , what are the statistical properties 
that your estimator can have? 

Conjecture 1 In broad generality (i.e. conditions similar to those in Theorem^) without know- 
ing anything further about the process {X(n)}, one can build a sequence of estimates {9*(n)} 
that satisfy a Large Deviation Principle (LDP) J^j. That is, for all Borel sets 

- inf J(x) < liminf- log P(9*(n) eB)< lim sup - log P(0*(n) € B) < - inf J(x), (3) 

xeB° n^oo n n^oo n x&B 

where B° denotes the interior of B and B denotes the closure of B, and J : [0, oo] i— > [0, oo] is 
a good rate function (lower semi- continuous and with compact level sets). Moreover, one can 
construct consistent estimates (J{x) = if and only if x = 9*). 

Equation Q can be compared with [21, Proposition 11.3.4] or [1CH Theorem 3]. The following 
is a corollary of the latter. 

Proposition 1 ( [10j ) Suppose that the sequence {X(n)} is i.i.d. with P(X(1) > 0) > and 
assume that \{9) = log£[e ex W] is finite in a neighborhood of the origin. Then with 



with J(0) = 0, J(x) > for all x > 0, and J(x) < oo for some x > 0. 

Consequently, we are conjecturing that estimating the tail exponent of Loynes' distribution is 
easier than estimating its mean. 

Estimation schemes and rigorous evidence in support of the conjecture. A range of 
approaches to estimating 9* can be deduced from the literature. In increasing order of directness, 



S w (n) := W(l) + • • • + W(n) 



the process {S w (n)/n 2 } satisfies the LDP with a good rate function J. That is, 



n 
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examples include the following. (I) For the GI/G/1 queue, techniques have been developed for 
estimating the whole of Loynes' distribution [23] from which 9* can be deduced. (II) Estimators 
of the sCGF have been proposed that use either a frequentist approach if {X(n)} satisfies a 
mixing condition [6J, or a Bayesian approach if {X(n)} is i.i.d. [12] [T3] or a Markov chain [23j . 
From these, estimates of 9* can be obtained (c.f. [E]). (•"••"••"•) Direct extremal estimators based on 
observations of the {W(?i)}, such as log(n)/ max(l, W(l), • • • , W(n)), have been studied [3J[26j. 

Our limited rigorous evidence for the validity of Conjecture [1] is based on two frequentist sCGF 
estimation schemes. We show that the conjecture holds if the non-overlapping partial sums of 
the increments {X(n)} are i.i.d. and bounded for a fixed block size. This result is deduced from 
[9]. Moving away from independence, we also present a new result: if {X(n)} forms a finite state 
irreducible Markov chain, then the conjecture holds. For the conjecture to be established in 
generality, new ideas are needed to extend to unbounded and non-independent increments that 
take more than finite values, but - arguably - the unboundedness is more technically challenging. 
We hope this will become apparent in the exposition that follows. 

The first result is based on the estimation scheme proposed in [6|. For an integer B < oo, 
construct the blocked process 

iB 

Y(i)= £ X(j). (4) 

j=(i-l)B+l 

Select B sufficiently large that you believe the blocked process {Y(n)} is close to being i.i.d. If 
the process {Y(n)} was i.i.d., then A(6>) in equation CO) reduces to A(0) = B' 1 log #(exp(0Y(l))). 
Given observations X(l), • • • ,X(n), this suggests using the MLE for A(0j3 and 9*: 

1 / 1 [n/Bl \ 
\(n, 9) := — log I -^j—^ e ey W I and finally 0*(n) := sup{0 : A(n, 9) < 0}. 

A central limit theorem for {0*(n)} is proved in |6j. As a corollary to a result regarding a related 
estimation problem, [9, Theorem 2] proves that the sequence of estimates {0*(n)} satisfy the 
LDP under less restrictive conditions than those of the following theorem, but does not establish 
its consistency. 

Theorem 2 (|9j) //, for some B, {Y(i)} is i.i.d. and Y{i) takes values in a closed, bounded 
subset S of the real line that does not include an open ball around the origin, then Conjecture 
[7] holds. 

A sketch of the proof of Theorem[2]is as follows. By Sanov's Theorem, the empirical laws {L(n)}, 
defined by L(n) := n~ l X^"=i ly(») f° r n — ^ satisfy the LDP in A / Ii(S), the space of probability 
measures on S, equipped with the topology of weak convergence. If Y(l) has measure /i, then 
the good rate function for the LDP is the relative entropy H(i>\[i). As X is bounded, for each 
9 € M the function x i— > exp(0x) is continuous and bounded. Thus if /i n =^ /u in A / (i(S), 
then log ^ n (exp(0x)) — > log //(exp(0x)) in M. As point-wise convergence of convex functions 
implies uniform convergence on bounded subsets, by the contraction principle {A(n, •)} satisfies 
the LDP in the space of convex functions equipped with the topology of uniform convergence on 
bounded subsets. To obtain the LDP for the tail exponent estimates {9*(n)}, one considers the 
continuity of A(n, •) i— > sup(0 : A(n, 9) < 0) and applies Puhalskii's extension of the contraction 
principle [251 Theorem 2.1]. As H(u\fj,) = if and only if v = /i, consistency follows from the 
variational form of the rate function for {0*(n)} that is given by the contraction principle. 

The need to exclude Y(n) taking values in an open ball around the origin is due to an artifact 
of the estimation scheme. If Y(l) = ■ ■ ■ = Y(n) = 0, then A(n, 9) = for all 9 and 9*(n) = oo. 



'This is known to be a biased estimator [13] 
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However, in the topologically nearby situation where Y(l) = Y(2) = ■ ■ ■ = Y{n) = e > 0, 
9*{n) = 0. That is, the estimation scheme possesses a discontinuity and the assumption is 
imposed to avoid it. 

Our second result is based on a frequentist version of the estimator used in |23j. Consider a 
finite state Markov chain {X(n)} with an irreducible transition matrix II = (tTj ,-) G [0, l] MxM 
and taking values {/(l), • • • , f(M)}. For each 9 G M, define the matrix Ilg = IIZA3, where 
is the matrix with diagonal entries exp(0/(l)),exp(0/(2)), . . . , exp(0/(M)) and all off-diagonal 
entries equal to zero. The sCGF of the partial sums process {S(n)/n} can be identified as 
X(9) = log p(Hq), where p is the spectral radius [3 Theorem 3.1.2]. With 0/0 := 0, this suggests 
that one constructs the MLE for II, II(n), defined by 

n( n )ij : = (^2 1 {(x(k-i),x(k))=(i,j)}^j I {^ x {X{h-V)=v\ , 

and then estimates \(9) and 9* by X(n,8) = log/3 (fl(n)e\ and 9*{n) = sup(6> : X(n,9) < 0). 

Theorem 3 If {X(n)} is a finite state Markov chain with an irreducible transition matrix H 
and f(i)y^0 for all i G {1, . . . , M}, then Conjecture^ holds true. 

Theorem [3] follows the arguments of Theorem [2] once we establish that {A(n, •)} satisfies the LDP. 
By [3 Theorem 3.1.13], the empirical laws of the transitions {^(n)}, ^(n) := n^ 1 Yli=i l(X(n-i),X(n))i 
satisfy the LDP in {(i,j) : > 0}. With <f> = (cfri, . . . , 4>m) being the stationary distribution of 
II, the rate function defined by equation (3.1.14)] is zero only at the values 4>iTTij- If 7Tjj = 0, 
then fr(n)ij = 0. For all such that 7Ty > 0, we have that 7t(n)nj\ can be expressed as a 
ratio of integrals against L2 (n) : 

= ( L 2(^)(l(x,j,)=(i,j))) / [ L 2(n)(\ x> y)=^,.))) • 

Thus the estimate II (n) is a continuous construction from L2(n) so that contraction principle 
can be applied and the estimates {II(n)} satisfy the LDP with a rate function H : [0, l] MxM t—>- 
[0, 00] that satisfies H(A) = if and only if A = II. If the sequence of matrices A n converge 
entry- wise to A, then by the continuous dependence of eigenvalues on entries [17] . log p(A n Dg) 
converges to log p(ADg) point-wise for all 9 and therefore uniformly on compact subsets of 9. 
Thus, from the contraction principle, {A(n, •)} satisfies the LDP and the rest of the proof follows 
as for Theorem 

Following the logic in [SJ Theorem 1], as an aside we note that based on either of these two 
estimation schemes one can construct estimates of the rate function for the partial sums process 
{S(n)/n}. Defining I(n,x) := sup e (#x — \(n,9)), if {A(n, •)} satisfies the LDP, then it can be 
shown that {I(n, •)} satisfies the LDP in the space of 1RU {00} valued convex functions equipped 
with the Attouch-Wets topology [lj|2j. That is, there is a LDP for estimating large deviation 
rate functions and, under the conditions of Theorems [2] and [3l the estimates are consistent. 

Example. Assume that the increments process {X(n)} forms a two-state Markov chain on the 
state space {—1, +1} with transition matrix 

U=( 1 ~ a "V Than, andr = log^- a 



P 1-PJ' \a + l3'a + p) \l-P 

where < a < ft < 1. The sequence {II(n)} satisfies the LDP with a good rate function 
H. It can be deduced from equation (3.1.14)] and the variational expression given by the 
contraction principle that H is finite only at matrices of the form 

A= ( 1 & ° a _ J , where a,b G (0, 1) 



5 



0.04 
0.03 
0.02 
0.01 


0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 

Figure 1: Rate function for {0*(n)} based on frequentist Markov chain estimator. Markov 
increments {X(n)} on {-1, +1} with a = 1/16, (5 = 3/16 and 9* = log(15/13) 



in which case 

H(A) . _A_ ( (1 _ o) log + alog (£)) + _±_ ( lbg (») + p - b) log . 

Consequently, the rate function for {#*(n)} is given by the one dimensional optimization 
J(x) = inf ( H(A(a, b) : log ( ^— £ | = x ) = inf Mfa, 1 - (1 - a)e- x )). 

V Vi-oy / ae(o,i) 

While J(x) cannot be determined in closed form, it can be readily calculated numerically. 
Figure [1] provides an example for given parameters; its non-convex nature for large x is apparent. 

Simulation evidence to support the conjecture. For the conjecture to be substantiated, 
the conditions under which Theorems [2] and [3] hold need to be significantly extended to cope 
with more general dependence structure of the increments and, perhaps more challengingly, to 
remove the boundedness assumptions. A prototypical example of the later is where Lindley's 
recursion describes the waiting times at the D/M/l queue. That is, the increments {X(n)} are 
i.i.d. with P(X(l) > x + 1/(3) = exp(— ax) for x > —f3~ l and a > /3. This example satisfies the 
conditions of Theorem Q] with 9*(< a) being the positive solution of the transcendental equation 

log (a/(a-0*))- 07/3 = 0, (5) 

which can be readily solved numerically. 

This example is delicate because the tail of increments decay exponentially, albeit with a larger 
exponent than 9*. Even though this example breaks the hypotheses of Theorem [2j we can 
implement the estimation scheme in [6] and see how it performs. Fixing B = 1, for a single 
realization X(l), . . . , X(50, 000) the left hand side of Figure [2] plots 9*(n) as a function of n as 
well as the actual Loynes' exponent 6* solving ([5]). This plot indicates that the estimates are 
converging to the correct value. The right-hand plot is an attempt to consider the existence of 
an LDP. For 2 x 10 5 independent simulations and a range of values of x, it plots n _1 times the 
logarithm of the number of samples such that 9*(n) — 9* > x, which we expect to converge to 
the rate function for the tail exponent estimates. This figure is suggestive of the existence of 
an LDP despite the departure from the boundedness conditions in Theorems [2] and [3j 

Further questions. Conjecture [T] is challenging, but Theorem [T] has been extended consid- 
erably so that more difficult questions can be asked. In a development of the sCGF approach 
in [15], [7] considers the case where the partial sums {S(n)/n} satisfy the LDP at a non-linear 
speed. By reconsidering the general scaling problem in terms of rate functions rather than 
sCGFs [8l Theorem 2.2] extends the results further while also correcting a lacuna (the omission 
of an assumption in the vein of Theorem [1] (iii)). 
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Figure 2: D/M/l queue with a = 1 and (3 = 10/11, giving 9* ~ 0.176. Shown on the left hand 
side are estimates of 9* based on equation with B = 1. Plots shown on the right hand side 
are estimates of the rate function for this estimator evaluated at 9* + x for several values of x. 



Theorem 4 (|8j) Assume that {S(n)/n } satisfies the LDP at speed n with rate function I 
(so that, roughly speaking, P(S(n) > xn A ) ~ exp(— I(x)n v ) ) and define 9* := inf x> o x v I (l/x" 4 ) . 
If, in addition, n~ v log P(S(n) > xn A ) < —9* for all n and all x sufficiently large, then 

lim -—rlogPCW >n) = -9*. 

n^oo n I 

For example, this Theorem holds if {X(n)} is i.i.d. with a Weibull distribution [22] or if {S(n)} 
corresponds to sampled fractional Brownian motion or a sampled two state process with Weibull 
sojourn times |llj . 

Among our questions are: can one simultaneously estimate V/A while estimating 9*? What 
impact does the non-linear scaling have on the properties of estimators? 
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